Floating point

Results: 1574



#Item
61Computer arithmetic / Computing / Arithmetic / Fixed-point arithmetic / Precision / Multiplyaccumulate operation / Rounding / FLOPS / 128-bit

Efficient Reproducible Floating-Point Reduction Operations on Large Scale Systems James Demmel, Hong Diep Nguyen ParLab - EECS - UC Berkeley SIAM AN13 Jul 8-12, 2013

Add to Reading List

Source URL: bebop.cs.berkeley.edu

Language: English - Date: 2013-11-23 11:48:10
62Computer arithmetic / Computing / Mathematics / Double-precision floating-point format / Q / Exponentiation / Denormal number / NaN / IEEE 754-1985 / Single-precision floating-point format

Denison University Floa.ng Point
 
 CS-281: Introduc.on to Computer Systems

Add to Reading List

Source URL: personal.denison.edu

Language: English - Date: 2015-12-02 11:24:11
63Computer arithmetic / Arithmetic / Binary arithmetic / Mathematics / Lexicology / Numeral systems / Elementary arithmetic / Hexadecimal / Hexadecimal numeral system / IEEE floating point / Computer number format / Rounding

A Program for Testing IEEE Decimal–Binary Conversion Vern Paxson CS 279 Prof. Kahan May 22, 1991

Add to Reading List

Source URL: www.icir.org

Language: English - Date: 2008-11-12 02:02:36
64Computer arithmetic / Computing / Mathematics / Theoretical computer science / Extended precision / IEEE floating point / Iterative refinement / Long double / Significant figures / Speedup / Double-precision floating-point format

Floating-Point Precision Tuning Using Blame Analysis Cuong Nguyen1 , Cindy Rubio-Gonz´alez1 , Benjamin Mehne1 , Koushik Sen1 , James Demmel1 , William Kahan1 , Costin Iancu2 , Wim Lavrijsen2 , David H. Bailey2 , and Dav

Add to Reading List

Source URL: crd.lbl.gov

Language: English - Date: 2015-04-20 03:24:44
65Computing / Computer architecture / Central processing unit / Computer hardware / Computer arithmetic / Microprocessors / Floating point / Floating-point unit / Fixed-point arithmetic / Embedded system

5e Rencontres Arithmétique de l’Informatique Mathématique (RAIMDijon, 20-22 juin 2012 Synthesis of fixed-point programs based on instruction selection ... the case of polynomial evaluation

Add to Reading List

Source URL: raim2012.u-bourgogne.fr

Language: English - Date: 2012-07-16 09:26:12
66Mathematics / Computer arithmetic / Smalltalk / Number / Single-precision floating-point format / Primitive data type / Continued fraction / Q / Arbitrary-precision arithmetic / Floating point / Fixed-point arithmetic / Real number

Introduction to Smalltalk - Chapter 5 - Numbers  Ivan TomekChapter 5 - Numbers Overview VisualWorks library contains many classes representing numbers of various kinds, mainly because

Add to Reading List

Source URL: sdmeta.gforge.inria.fr

Language: English - Date: 2014-10-09 10:38:17
67Computer arithmetic / Software / Computing / Mathematics / GNU MPFR / Rounding / Interval arithmetic / GNU Multiple Precision Arithmetic Library / Maple / Fixed-point arithmetic / IEEE floating point / TeX

Generating a Minimal Interval Arithmetic Based on GNU MPFR (in the context of the search for hard-to-round cases) Vincent LEFÈVRE Arénaire, INRIA Grenoble – Rhône-Alpes / LIP, ENS-Lyon

Add to Reading List

Source URL: www.vinc17.org

Language: English - Date: 2015-06-18 06:12:50
68Computing / Color space / Graphics file formats / Computer arithmetic / Error diffusion / Image processing / Lookup table / RGB color model / Dither / SRGB / Rounding / Computer number format

High-speed Conversion of Floating Point Images to 8-bit (online IDBill Spitzak, Digital Domain ∗ Introduction Most rendering software today destroys precise lighting and shading calculations by doing an inaccura

Add to Reading List

Source URL: spitzak.github.io

Language: English - Date: 2014-11-18 22:38:27
69Computer arithmetic / Mathematics / Classical music / Fixed-point arithmetic / Integer / Q / Honegger / Floating point

Lineare Algebra: Endliche Arithmetik Dominik Honegger, Dezember 2015 Dominik Honegger |

Add to Reading List

Source URL: www.cvg.ethz.ch

Language: English - Date: 2015-12-18 04:26:46
UPDATE